RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects

نویسندگان

چکیده

We present RGB-D-Fusion, a multi-modal conditional denoising diffusion probabilistic model to generate high resolution depth maps from low-resolution monocular RGB images of humanoid subjects. RGB-D-Fusion first generates map using an image conditioned and then upsamples the second on RGB-D image. further introduce novel augmentation technique, noise augmentation, increase robustness our super-resolution model.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Depth Completion of a Single RGB-D Image

The goal of our work is to complete the depth channel of an RGB-D image. Commodity-grade depth cameras often fail to sense depth for shiny, bright, transparent, and distant surfaces. To address this problem, we train a deep network that takes an RGB image as input and predicts dense surface normals and occlusion boundaries. Those predictions are then combined with raw depth observations provide...

متن کامل

Kinect-based Real-time Rgb-d Image Fusion Method

3D reconstruction of indoor environments based on vision has been developed vigorously. However, the algorithm’s complexity and requirements of professional knowledge make it restricted in practical application. With the proposition of the concept of Volunteered Geographic Information (VGI), the traditional method is no longer suitable for VGI. So in this work we utilize consumer depth cameras ...

متن کامل

Shape Preserving RGB-D Depth Map Restoration

The RGB-D cameras have enjoined a great popularity these years. However, the quality of the depth maps obtained by such cameras is far from perfect. In this paper, we propose a framework for shape preserving depth map restoration for RGB-D cameras. The quality of the depth map is improved from three aspects: 1) the proposed region adaptive bilateral filter (RA-BF) smooths the depth noise across...

متن کامل

Depth-aware CNN for RGB-D Segmentation

Convolutional neural networks (CNN) are limited by the lack of capability to handle geometric information due to the fixed grid kernel structure. The availability of depth data enables progress in RGB-D semantic segmentation with CNNs. State-of-the-art methods either use depth as additional images or process spatial information in 3D volumes or point clouds. These methods suffer from high compu...

متن کامل

RGB-D depth-map restoration using smooth depth neighborhood supports

A method to restore the depth map of an RGB-D image using smooth depth neighborhood (SDN) supports is presented. The SDN supports are computed based on the corresponding color image of the depth map. Compared with the most widely used square supports, the proposed SDN supports can well-capture the local structure of the object. Only pixels with similar depth values are allowed to be included in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3312017